WO 2004/051552 



10/536591 

PCT/GB2003/005235 



1/26 




Fig. 1 



110 




200 



130 



3~ 



100 



140 



image 
Processing 



120 



Face 
Detector 



■ZZO Q 



230 



Lens 
Control 



190 



User 
Controls 



Speech 
Detector 



240 



180~ 




Audio 
Processing 



150 



-160 



y 



210 



-170 



Fig. 2 



220 
From Microphone(s) 

BEST AVAILABLE COPY 



SUBSTITUTE SHEET (RULE 26) 



WO 2004/051552 



10/536591 



PCT/GB2003/005235 



2/26 



300 



Set of Face 
{and Non-face) 
Training Images 



Training Process 



310 



330-xj 





320 



Fig. 3 



320 



Histogram Data 



350 



Image or Video Data 



340 



Face Detection 



-►Face / Non-face 



Fig. 4 



SUBSTITUTE SHEET (RULE 26) 



10/§3659£ 



V"-;.:.' 

WO 2004/051552 PCT/GB2003/005235 



3/26 





Large training set Very large set 

of 64x64 windows of 16x16 blocks 



Fig. 6 



SUBSTITUTE SHEET {RULE 26) 



WO 2004/051552 



10/536 

PCT/GB2003/005235 



4/26 




Fig. 8 



SUBSTITUTE SHEET (■RULE 26) 



WO 2004/051552 



PCT/GB2003/005235 




Frequency of occurence of 
bin number at block position (i j) 




430 



Bin number ^representing 
combined quantised attributes) 

HISTOGRAM 



Fig. 9 



SUBSTITUTE SHE€T {RULE 26) 



WO 2004/051552 



10/536591 



PCT/GB2003/005235 









j 

X 






~4~ 


: 


















I 


1 


r 








: 


h 






i 


rl- 








i 







64x64 window 
from test image 



6/26 



490 500 510 




logfcC'Jlh 



Set of blocks \ 
extracted from all \ 
chosen positions \ 
in window 



IoqIpOJ)]' 



Bin number for 
block at position fjj) 







\ \ 

t 




did 




, — i — 




r — [—4 






— j — 


— 4 — «? — 






1 1 


: : 


— 

— , 


i 


— 1 — 


1 -i ! i 

•11 




L j 










" i 


} 


: 









Fig. 11 




460 



470 



480 

Histogram bin 
number 



64x64 window / SetofEigenblocks Ekjenblock Quantised 
45q7 weights weights 

Fig. 10 



SUBSTITUTE SHEET (RULE 26) 



10/53659 



WO 2004/051552 



PCT/GB2003/005235 



7/26 




_l I L- 



-I I L. 



g fc CM 



^2 5 
<=> = 

ZZ CD 



CD 



CD CD CD CD O O CD CD CD CD 

cz> io cd wo cd m cd to cd to 

seouajnooo)OJ9qiunN 




CD CD CD CD CD CD CD CD CD CD 
if) «^ (O CO CM CM *r— 

saouajnoooiojaqiunN 



CDCDCDCDCDCDCDCDCD 
CD tO CD LO CD LO CD UD CD 
lO^^-COCOCMCM^T- 

seou9jnDoopj3qiunN 



S 



SUBSTITUTE SHEET (RULE 26) 



WO 2004/051552 



10/536-5 



PCT/GB2003/005235 



8/26 



~i 1 1 1 1 r 



S o CM 



i E 2> 



o o o o 



.... _ «=><=> ^ 

r*— co to "^r co cvi ««— 



saouainooo jo jaqwnN 



~T 


i 


» 


1 - 1 




I 




























































































— L 


1 _J 





lO 
CM 



CD CD 

cvi c 



io <- 



CQ 



"D 

eg 



LL 



o o cz> co co co <o 
oo co uo co cni 




saouainooopjequjnN 



ro co co co co co o£ 



oo r*-- co io co cni -r— 

seouajnoDO p jaqtuntsl 



SUBSTITUTE SHEET (RULE 26) 




Fig. 13a Fig. 13b Fig. 13c 



536 




Fig. 13f I 

Fig. 13g 



SUBSTITUTE SHEET (RULE 26) 



20/536 



WO 2004/051552 



PCT/GB2003/005235 



10/26 



542 



User Metadata 



544 



Camera Settings 



560 v 



Prediction 



Kalman Filter 



Update 



Video Data 



540 



545 



Face Detection 



550 



Skin Colour 
Matching 



J 



Comparison of 
Eye Positions 



Comparison of 
Eye Positions 



570 



Decision on which 
Eye Positions to 
Accept 



580 



Shot Boundaries : 



565 



Fig. 14 



SUBSTITUTE SHEET (RULE 26) 



•) • 

WO 2004/051552 

11/26 




O O 



Fig. 15a 

640 



o o 



Fig. 15b 




Fig. 16 



SUBSTITUTE SHEET {RULE 26) 



10/536 



WO 2004/051552 PCT/GB 2003/005235 



12/26 




Fig. 18 



SUBSTITUTE SHEET (RULE 26) 



1U/53659 



WO 2004/051552 



PCT/GB2003/005235 



13/26 



800 



Picture Stamp A 



840 




Picture Stamp B 
860 / 




si m 



IS Ml P US 

gal isl ml m 



810 



Fig. 19a 



pt TT-n-, rTT 



820 830 

Fig. 19b 



T-tTTIT 



Face A 



O 



FaceB 



850 



Fig. 19c 



910' 



910" 




912 



914 





^916 



914 



Fig. 21a 



Fig. 21b 



SUBSTITUTE SHEET (RULE 26) 



10/536 



WO 2004/051552 PCT/GB2003/005235 

14/26 



Z 



900 
2— 



s**^ 1 '\ - ^ 

□ □ □ 

□ □ □ 



In Ibid 



940 



920 930 



TTT 



925 



TTT 



935 



Fig. 20 



SUBSTITUTE SHEET (RULE 26) 



JO/536 



WO 2004/051552 



PCT/GB2003/005235 



15/26 




Fig. 22a 



1010 




Fig. 22b 




Fig. 22c 



SUBSTITUTE SHEET {RULE 26) 



i J/5 



WO 2004/051552 



PCT/GB2003/005235 



16/26 




SUBSTITUTE SHEET <RULE 26) 




SUBSTITUTE SHEETS RULE 26) 



10/536 59t 



WO 2004/051552 



PCT/GB2003/005235 



18/26 



camera 



receiver 




1300 



1310 



1320 




1330 



Fig. 26 



SUBSTITUTE SHEET (RULE 26) 



tO/536 



WO 2004/051552 PCT/GB 2003/005235 



19/26 





SUBSTITUTE SHEET (RULE 26) 



WO 2004/051552 



PCT/GB2003/005235 



20/26 



camera 



capture 
images 



receiver 



highlight & 
label faces 



transmit required 
face 




1350 



1360 



Fig. 28 



SUBSTITUTE SHEET {RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



WO 2004/051552 



10/536 

PCT/GB2003/005235 



22/26 




SUBSTITUTE SHEET 4 RULE 26) 



WO 2004/051552 



10/536591 



PCT/GB2003/005235 



23/26 



camera 



receiver 




1410 



user can select 

one face for 
enlarged display 



Fig. 31 



SUBSTITUTE SHEET ^RULE 26) 



WO 2004/051552 PCT/GB2003/005235 



24/26 




SUBSTITUTE SHEET (RULE 26) 



10/536 



WO 2004/051552 



PCT/GB2003/005235 



25/26 



camera 



capture 
images 



1300 



detect 
faces 



1310 



transmit face 
nearest to 
active microphone 



if 



1440 



-1460 



detect new active 
microphone 



receiver 




1450 



Fig. 33 



SUBSTITUTE SHEET (RULE 26) 



WO 2004/051552 



10/536 

PCT/GB2003/005235 



26/26 



camera 



receiver 




1300 



transmit images 
faces at high res 
background at 
low res 



1310 



1470 



1480 



display image 
label faces 



1490- 



user selects 
face for 
enlarged display 



Fig. 34 



SUBSTITUTE SHEET (RULE 26) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record. 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



